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ABSTRACT 

We report the results of a search for the flavor-changing neutral-current 
decays D+ —)■ ijl~ and D+ —)■ Tr+e+e" in data from Fermilab charm 

hadroproduction experiment E791. No signal above background is found, and 
we obtain upper limits on branching fractions, B{D^ —)■ < 1.8x10^® 

and R(D+ —^ 7r+e+e^) < 6.6 x 10^®, at the 90% confidence level. 

(Submitted to Physical Review Letters) 
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Flavor-changing neutral-current (FCNC) decays have played a major role 
in our understanding of weak decay processes. For example, the absence 
of such currents in neutral kaon decays in the strange quark sector helped 
motivate the Glashow-Iliopoulos-Maiani mechanism [1] for weak decay that 
predicted the existence of the charm quark before its experimental obser¬ 
vation. In this Letter we present branching fraction limits from Fermi- 
lab experiment E791 for FCNC decays in the charm quark sector, D+ ^ 
TT+e+e" [2]. These decays would proceed through an effective c ^ u 
quark transition. Such a transition is forbidden at the tree level within the 
Standard Model, but can occur through higher-order loop diagrams. The 
decays are thus sensitive to physics at high mass scales that 

cannot be accessed directly [3]. 

Within the Standard Model, the contribution of short-distance electroweak 
processes to B{D^ n~^£~^£^) is expected to be less than 10^® [4]; in 
contrast, the best published experimental limits are only 2 to 3 x 10^^ 
(yr+e+e^) [5] and 2 x 10^"^ [6]. Three-body FCNC decays such 

as 7r~^£'^£~ are more sensitive to new physics involving vector or axial 

vector currents than are corresponding two-body decays such as ^ £+£- 
because three-body decays do not suffer from helicity suppression imposed 
by angular momentum conservation. In the search reported here, we find 
no evidence for FCNC ^ yr+£+£^ decays. We set upper limits on the 
branching fractions that are an order of magnitude below those previously 
published. 

The data were recorded from 500 CeV/c yr“ interactions in five thin foils 
(one platinum, four diamond) separated by gaps of 1.34 to 1.39 cm. The E791 
spectrometer is an upgraded version of the apparatus used in Eermilab charm 
experiments E516, E691, and E769 [7]. Momentum analysis is provided by 
two dipole magnets which bend particles in the horizontal plane. Twenty- 
three silicon microstrip detectors provide position information for track and 
vertex reconstruction. 

Muon identification is obtained from a plane of 16 scintillation counters 
located behind shielding with a thickness equivalent to 2.5 meters (15 in¬ 
teraction lengths) of steel. These counters, 24 m from the target, are each 
14 cm by 300 cm. They are mounted with their long sides horizontal and 
thus measure displacement in the vertical (nonbend) direction. The prob¬ 
ability for misidentifying a hadron as a muon rises from (4.5 ± 0.5)% for 
momenta greater than 20 CeV/c to about 20% at 7 CeV/c. The efficiencies 
of the muon counters were measured to be (99 ± 1)% in special runs using 
independent muon identification. 

Electrons are identified by a calorimeter [8] of lead and liquid scintil¬ 
lator located 19 m from the target. The scintillator is divided into strips 
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3.17 cm in width [9], oriented transverse to the beam direction, with succes¬ 
sive scintillator planes alternating among three stereo projections. Electron 
identification is based on energy deposition and transverse shower shape in 
the calorimeter. The probability that a pion is misidentified as an electron 
is 0.8%, nearly independent of momentum. Electron identification efficiency 
varies from 62% for momenta below 9 GeV/c to 45% for momenta above 20 
GeV/c. 

The experiment recorded 2 x 10^° events with a loose transverse energy 
trigger. After reconstruction, events with evidence of well-separated pri¬ 
mary and secondary vertices were retained for further analysis. To search 
for EGNC decays in an unbiased way, the Gabibbo-suppressed decay 
Tr^TT+Tr"'' was used to determine a single set of track and vertex selec¬ 
tion criteria for all decays. The criteria are chosen to maximize Ns / V Nb , 
where Ns and Nb are the numbers of signal and background events, respec¬ 
tively, in the Tr^Tr+Tr'*' decay. 

To separate charm candidates from background, we require the secondary 
vertex to be well-separated from the primary vertex and located well outside 
the target foils and other solid material, the momentum vector of the candi¬ 
date to point back to the primary vertex, and the decay track candidates 
to pass closer to the secondary vertex than the primary vertex. Specifically, 
a three-prong secondary vertex must be separated by > 20 ai from the pri¬ 
mary vertex and by > 5.0 ax from the closest material in the target foils, 
where in each case is the calculated longitudinal resolution in the mea¬ 
sured separation. The sum of the momentum vectors of the three tracks 
from this secondary vertex must miss the primary vertex by < 40 yum in the 
plane perpendicular to the beam. We form the ratio of each track’s smallest 
distance from the secondary vertex to its smallest distance from the primary 
vertex, and require the product of these ratios to be less than 0.001. Einally, 
the net momentum of the candidate transverse to the line connecting the 
primary and secondary vertices must be less than 250 MeV/c. 

The longitudinal and transverse position resolutions for the primary ver¬ 
tex are 350 /rm and 6 /rm, respectively. Eor three-prong secondary vertices 
from decays, the transverse resolution is about 9 /rm, nearly independent 
of momentum; the longitudinal resolution is about 360 /rm at 70 GeV/c and 
increases roughly linearly with a slope of 30 yum per 10 GeV/c. Normaliz¬ 
ing separation distances by their estimated resolutions reduces momentum- 
dependent effects. 

The W“7r'''7r''' channel serves as the normalization mode for the EGNC 
branching fraction measurements; this mass spectrum, obtained with the 
selection criteria described above, is shown in Eigure 1. A fit to a Gaussian 
signal and an exponential background gives 37,000 W^7r+7r+ events. 
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Figure 1: Mass spectrum of candidate D~^ —>■ events with final opti¬ 

mized selection criteria, used to provide the normalizing signal for FCNC analyses. 
The curve is a fit to a Gaussian signal and an exponential background. 


The measured mass resolution of the peak is (12 ± 1) MeV/c^. 

In addition to meeting the selection criteria described above, candidates 
for are required to have two oppositely-charged tracks from 

the candidate decay vertex identified as muons. Since the momenta and 
directions of charged tracks are measured in tracking devices upstream of 
absorbing material in the muon system, multiple scattering in this shielding 
introduces a significant uncertainty at the scintillation counters in predicted 
positions of low-momentum tracks. To identify muons efficiently, we require 
a signal from a scintillation counter whose closest edge is within 1.0 (Jms from 
the track’s projected vertical position, where aus is the predicted root-mean- 
square position error due to multiple scattering for a muon of the measured 
momentum. Muon candidates must have momenta greater than 7 GeV/c, 
and the two muon candidates must be identified by separate scintillation 
counters. The latter requirement reduces background by more than 50% 
and, for a uniformly populated Dalitz plot, reduces the dimuon efficiency by 
only 14%. A major source of candidates with 7v~^fj,'^fi~ invariant mass below 
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Figure 2: Search for a D~^ —)■ n'^n~ signal, (a) Invariant mass spectrum under 
a jj ,'^hypothesis but with no muon identification requirement (diamonds). 
The curve, which is a fit to the sum of Gaussian peaks from misidentified D~^ —)■ 
7r“7r"’“7r"’“ and Df —)■ 7r“7r"’“7r"’“ and an exponential backgronnd, determines the 
central values and widths of the peaks, (b) Invariant 'k~^ijl~ mass spectrum for 
events with mnon identification (histogram). The solid curve is the best fit to a 
sum of contributions from D+ —)■ feedthrough from D+ —)■ Tr^vr+Tr"'' and 

Dt —)■ vr TT+vr"'', and an exponential background. The dashed curve shows the size 
and shape of the D~^ —)■ contribution ruled out at 90% CL. 


that of the is misidentified decays. We exclude candidates with 

iL^7r+7r+ invariant mass inside the interval 1.850 to 1.890 GeV/c^. This 
requirement has negligible effect on the 7r+//+/i^ efficiency but makes 

fitting the background more straightforward. 

In the search for a jjL~ signal it is important to account 

correctly for feedthrough from misidentified > Tr^TT+Tr"'' and 

7r^7r+7r+ decays. The procedure is illustrated in Figure 2. First, the in¬ 
variant mass spectrum, under a fjT hypothesis but with no muon iden¬ 
tification requirement (Figure 2a), is fit to the sum of an exponentially- 
falling distribution and two Gaussians describing the > Tr^Tr+Tr"'' and 

Dt ^ TT TT+TT"'' peaks (solid curve). Because of the incorrectly-assigned 
daughter masses, these 7r^7r+7r+ signals are broadened and shifted downward 
by about 15MeV/c^ from the true parent masses. The central values and 
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widths of these peaks are retained for the fit described below. Next, the 
muon identification requirement is imposed, giving the spectrum shown by 
the histogram in Figure 2b. We then search for an FCNC signal with a 
binned maximum likelihood fit with four components: a Gaussian centered 
at the mass for two Gaussians describing feedthrough 

from and , and an exponential distribution. 

The central values and widths of the feedthrough peaks are constrained to 
the values from the fit in Figure 2a, and the width of the signal Gaussian is 
fixed at its observed value in 7r^7r+7r+ decays, 11 MeV/c^. The sizes of 

the four contributions are allowed to vary independently. The result of this 
fit is shown by the solid curve in Figure 2b. We find 0.3511'^^ events from 
D~^ —> TTThe 90% confidence level (GL) upper limit is 4.36 events, 
determined by the point at which the log likelihood function falls below its 
maximum value by (1.28)^/2. The size and shape of the signal excluded at 
90% CL is shown by the dashed curve in Figure 2b. 

Variations on this technique give consistent results. Constraining the 
relative amounts of D~^ 7r~7r~^7r~^ and Df 7r~7r~^7r~^ feedthrough to 

be the same as in Figure 2a leads to an upper limit of 3.2 events at 90% 
CL, while use of a simple mass window instead of a maximum likelihood 
fit gives 4.5 events. We have also tested the procedure with ensembles of 
simulated experiments in which fixed numbers (2 - 10) of simulated FCNC 
signal events, drawn randomly from a Gaussian mass distribution, are added 
to the observed spectrum and successfully found by the fit. 

The 90% CL upper limit on the branching fraction B for D~^ yr+yu+yu" 
is given by 

B{D+ ^ yr+^+^-) < b{D+ ^ W-yr+yr+) 

( K yr+yr+) ? 7 ^ 

where [/(yr+yu+ju^) = 4.36 is the 90% CL upper limit on the number of signal 
events, V(iL^yr+yr+) = 37, 006 ± 204 is the number of events in the normal¬ 
izing channel, 7]^ = 0.625 ±0.075 is the relative efficiency of the yr^/i"''//" and 
K~7r~^7r~^ channels, fsYS = 1-03 is the factor [10] by which the limit is de¬ 
graded by systematic uncertainties, and B{D~^ K~7r~^7r~^) = (9.1 ± 0.6)% 

[ 11 ]. 

The relative efficiency is determined primarily from a Monte Carlo cal¬ 
culation. It includes factors arising from different decay kinematics (1.12), 
the 7 GeV/c muon track momentum requirement (0.96), the muon identifica¬ 
tion (0.67) and separate-counter (0.89) requirements, and the relative trigger 
efficiency (0.98). The systematic uncertainties which give rise to fsvsi to¬ 
talling 15% when added in quadrature, include those in W(iL^yr+yr+), and 
B{D~^ K^7r~^7r~^). The factor fsYS is then calculated by the prescription 

of Ref. [10]. 
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Figure 3: Search for a D~^ —)■ vr+e+e" signal: invariant mass spectrum with 
TT+e+e^ hypothesis. Three events pass the electron identification requirement 
(histogram). One of them lies in the signal region between the arrows. Back- 
gronnd is estimated from the 7r"’“e"’“e“ invariant mass spectrnm withont electron 
identification reqnirement, normalized to two events ontside the signal region, as 
shown by the diamond points. The dashed cnrve shows the size and shape of the 
bremstrahllung-broadened D~^ —>■ vr+e+e^ signal ruled out at 90% CL. 


The resulting upper limit on the branching fraction is B[D^ —> ii~) < 

1.8 X 10“® at 90% CL. The limit is quite stable under variation of the vertex 
selection criteria and of the muon momentum requirements. To facilitate 
combining our result with those of other experiments, it can be expressed as 
a branching fraction measurement: B{D^ 7r+/i+/r^) = (0.14tJ;o) x 10^^, 
where the quoted errors are statistical only; the systematic errors, approxi¬ 
mately 15% of B, are negligible by comparison. 

Monte Carlo calculations show that the experimental acceptance is nearly 
uniform across the Dalitz plot for squared dimuon mass greater 

than 0.8 (GeV/c^)^. For smaller the acceptance decreases roughly lin¬ 
early to near zero at minimum [12]. 

The search for > vr+e+e" employs vertex selection and 

exclusion criteria identical to those for Tr+zi+yU". Candidate 
TT+e+e^ decays contain two oppositely-charged tracks identified as electrons 
and have invariant mass consistent with . Because there are 

only three identified vr+e+e" candidates, we use the simple search-window 
procedure illustrated in Figure 3. The yr+e+e" events are shown as a solid 
histogram. One of them (shaded) is inside the search window (indicated by 
arrows) of 1.830 to 1.890 GeV/c^. The yr+e+e^ spectrum without electron 
identification is normalized to two events outside the search window, and 
then used to predict the expected number inside the window: 0.42 ± 0.29 
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events. The signal is thus 0.58 ± 1.04 events. Using the method for Poisson 
processes with background described in Reference [11], we find the 90% CL 
upper limit for a signal of one event with 0.42 expected background events 
to be 3.56. The size and shape of the signal excluded at 90% CL is shown 
by the dashed curve. 

The upper limit on B{D~^ yr+e+e") is calculated from 

B{D* ^ ^+e+e-) < - fsYsB{D+ -Y R-wV) 

IM [K TT+TT+j r]e 

where U{7r~^e'^e^) = 3.56 events at 90% CL, N{K^7r~^7r~^) = 37,006 ± 204 
events in the normalizing channel, r]e = 0.138 ± 0.021, and fsYS = 1.04. 
The relative efficiency rje of yr+e+e" and determined from a Monte 

Carlo calculation, is dominated by the dielectron detection efficiency (0.32) 
and by the exclusion of much of the expected long bremsstrahlung tail in 
a D~^ yr'''e'''e^ mass peak from the mass window (0.66). The system¬ 

atic uncertainties which give rise to fsYS [10], totalling 16% when added in 
quadrature, include those in N{K~7r~^7r~^), r\e and B{D^ iL^yr+yr"''). 

The resulting upper limit on the branching fraction is B{D^ yr+e+e^) < 
6.6 X10^^ at 90% CL. Alternatively, the branching fraction with one standard 
deviation errors is B{D~^ 7r~^e~^e^) = (1.0 ± 1.9) x 10^^. The efficiency 

across the Dalitz plot is approximately uniform for squared dielectron masses 
rUgg above about 0.4 (GeV/c^)^, but decreases roughly linearly to near zero 
at minimum meg [12]. 

In summary, Fermilab experiment E791 has obtained new upper limits 
on the branching fractions B for the three-body flavor-changing neutral- 
current decays D~^ yr and 79+ ^ yr+e+e" that are an order of 
magnitude smaller than those previously published. At the 90% CL B{D~^ 
jj,^) < 1.8 X 10^^, and B{D^ yr+e+e^) < 6.6 x 10^^. 

We gratefully acknowledge the assistance of the staffs of Fermilab and 
of all the participating institutions. This research was supported by the 
Brazilian Conselho Nacional de Desenvolvimento Cientifico e Technologico, 
CONACyT (Mexico), the Israeli Academy of Sciences and Humanities, the 
Fulbright Foundation, the U.S. Department of Energy, the U.S.-Israel Bina¬ 
tional Science Eoundation, and the U.S. National Science Eoundation. Eermi- 
lab is operated by the Universities Research Association, Inc., under contract 
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